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Given discrete degrees of freedom (spins) on a graph interacting via an energy function, what can 
be said about the energy local minima and associated inherent structures? Using the lid algorithm 
in the context of a spin glass energy function, we investigate the properties of the energy landscape 
for a variety of graph topologies. First, we find that the multiplicity N s of the inherent structures 
generically has a lognormal distribution. In addition, the large volume limit of In {N 3 )/{ln N s ) differs 
from unity, except for the Sherrington-Kirkpatrick model. Second, we find simple scaling laws for 
the growth of the height of the energy barrier between the two degenerate ground states and the size 
of the associated valleys. For finite connectivity models, changing the topology of the underlying 
graph does not modify qualitatively the energy landscape, but at the quantitative level the models 
can differ substantially. 
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I. INTRODUCTION 

Graphs and networks are a subject of study on their 
own, and more recently the possibility of doing statistical 
mechanics on these kinds of structures has been investi- 
gated. In many of the corresponding models, even though 
the local minima of the energy function proliferate, one 
knows little about their numbers or about their organ- 
isation. Such properties are usually studied within the 
"energy landscape" paradigm which embodies both ener- 
getic and entropic effects. In fact, a complete knowledge 
of this landscape tells one everything about low energy 
excitations; that kind of information can be precious for 
understanding both equilibrium and out of equilibrium 
low temperature properties. This is especially true for 
"complex" systems that exhibit glassy behavior; these 
arise in many subjects of research, ranging from material 
science to protein folding. 

Our purpose here is to find out how the "shape" and 
the scaling properties of such energy landscapes depend 
on the structure of the underlying graph when the Hamil- 
tonian function is of the spin glass type. For this purpose, 
we shall consider four types of random graphs (cf. refs. 
0, 0,0,3)- Previous studies have considered the ther- 
modynamics of these systems: at high temperature the 
system is paramagnetic, and at low temperatures there 
is a spin glass phase in which the magnetizations of the 
spins freeze in apparently random directions. However 
relatively little attention has been put into energy land- 



scape questions when the underlying graphs are random. 
In particular, nearly all previous landscape work on our 
classes of graphs has been limited to the Sherrington- 
Kirkpatrick case 0]: the inherent structures (referred to 
as metastable states in the spin-glass community) have 
been tackled analytically 5| , and barriers sizes have been 
considered indirectly, either via free-energy barriers near 
the critical temperature 0], or by numerical studies of 
relaxation kinetics in Monte Carlo 0] • Finally, there 
is very little work on the size of the ground-state val- 
leys associated with the configurations that are reachable 
when staying below a given barrier. For all of our random 
graph ensembles, we shall first consider all configurations, 
enumerating the inherent structures as a function of their 
energy. We shall also use the lid algorithm 0, 0, to 
obtain all configurations connected to the ground state 
while staying below a given energy; this gives the bar- 
rier to go from the ground state to its inverted pair and 
the size of the associated basin. In spite of the modest 
graph sizes considered, a considerable amount of informa- 
tion on these observables (and in particular their scaling 
laws) can be reliably extracted. 

The paper is organized as follows. The models are de- 
fined in Sectm Then we examine all the local minima 
of the Hamiltonian and study their statistics (Sect lUlJ l. 
In Sect llVI we investigate in detail the scaling of the en- 
ergy barrier separating the two degenerate ground states 
of these systems. We also extract the size of the valley 
around each ground state. We conclude in Sect El 
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II. MODELS 

A. Geometry: random graphs 

A first component of our models consists of a graph on 
whose N vertices the spins will reside. We consider four 
classes of graphs with markedly different topologies: 

(1) Random k-regular (KR) graphs, where the degree 
(connectivity) of each node is fixed to k. 

(2) Erdos-Renyi (ER) graphs, where each edge is put 
down with probability p — a/N; as a result, at large TV, 
the degree of a vertex is a Poisson distributed variable of 
mean a. 

(3) Barabasi-Albert (BA) scale-free graphs generated 
by the usual growth process with the preferential attach- 
ment property Here, at large N, the degree distri- 
bution has a fat tail. In contrast to the previous graphs, 
the graphs in this class are highly inhomogeneous. 

(4) Complete (i.e. fully connected) graphs. Here, the 
number of edges is no longer linear in N, but quadratic. 



B. Matter: frustrated Ising spins 

To each edge ij of the underlying graph, we indepen- 
dently assign a weight according to a distribution 
symmetrized about 0, so both signs arise with equal prob- 
ability. These elements, i.e. the random edges and their 
associated weights JJy , define the system's "quenched dis- 
order" . The statistical mechanics problem arises when 
one assigns degrees of freedom to each site and has them 
interact. Here we put an Ising spin <r< on each site i; the 
system's Hamiltonian is taken to be 

<«> 

where the sum runs over all pairs of sites connected by an 
edge of the graph. If not stated otherwise the weights Jy 
are generated from a Gaussian distribution. This Hamil- 
tonian defines a spin glass, the frustration coming from 
the fact that in general not all terms in the energy func- 
tion can be simultaneously at their minimum. There is an 
obvious global Z(2) symmetry corresponding to flipping 
simultaneously all the spins. Finally, because the Jij are 
i.i.d. and continuous random variables, generically there 
are just two degenerate ground states (related by a global 
spin flip). 

We shall be interested in the large N limit, in which 
case it is appropriate to keep the system's energy exten- 
sive. For instance in the Sherrington-Kirkpatrick (SK) 
model Q one sets Var[Jjj] = 0(1 /N). More generally, if 
the mean connectivity grows, we want to keep the energy 
density from diverging; in all that follows we shall thus 
take 

Var[Jy] = (2) 
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FIG. 1: Boolean (hyper) cube representing the possible con- 
figurations of a three-spin system (N = 3). 

were (k) is the average graph degree. This choice of scale 
eliminates trivial differences between the values of the 
same observables in distinct models, allowing for a more 
direct comparison. 



C. Algorithmic procedures 

The 2 N configurations of the spin glass are con- 
veniently represented by vertices of an A-dimensional 
Boolean hypercube: each vertex is identified by a bi- 
nary number 0, . . . , 2 N — 1 of N bits, a bit value of 1 
(0) at the i-th position corresponding to the z-th spin 
being up (down). Neighbor vertices differ in exactly one 
bit (see fig. ^ where the case TV = 3 is illustrated). To 
each configuration (vertex of the hypercube) we associate 
the energy calculated from the Hamiltonian (JJJ . The set 
of vertices of the Boolean hypercube is our configura- 
tion space; these and their associated energies define an 
energy landscape, the object of our study. If a vertex 
has an energy strictly lower than that of all of its near- 
est neighbors, the configuration is "one-spin- flip stable" 
and hereafter will be referred to as an inherent struc- 
ture. (As mentioned previously, such configurations are 
sometimes called "metastable states"). We use this vo- 
cabulary, proper to landscape studies, in the spin-glass 
context. Note that no gradient algorithm (like those ref- 
ered to when inherent structures were originally defined 
on systems with continuous variables) will be employed 
in this work. 

One instance of a problem is created by generating a 
random graph in the desired class with N vertices fol- 
lowed by the generation of the set of weights Jij. The 
energy landscape of that instance is then probed using 
algorithms which examine all configurations, their ener- 
gies, etc... The process is then repeated for as many 
instances as possible so statistical properties can be in- 
ferred. Finally, one studies the N dependence to extract 
the large N scaling laws. 

For N < 32, a single PC machine word suffices to 
store the whole bit sequence representing a configuration 
on the Boolean hypercube, and furthermore many of the 
operations on configurations are easily implemented as 
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binary operators on the corresponding machine words. In 
practice, TV rs 30 turns out to be a natural performance 
limit for our programs since for larger N the enumera- 
tion of all 2 N configurations takes too much computation 
time. 

The exhaustive enumeration of all inherent structures 
is in principle straightforward. On a 2GHz PC, it re- 
quires a few hundred seconds of CPU time for a single 
instance of 30 spins. The determination of the height of 
the energy barrier separating the two degenerate ground 
states is more time consuming^ We use for this purpose 
a variant of the lid algorithm[l3j. Starting from just one 
of the two degenerate ground states, one iteratively steps 
to neighboring configurations as long as their energy is 
below a prescribed "lid" value. Using a pictorial analogy, 
one can imagine water spreading out in a mountainous 
landscape: Given the source at the chosen ground state, 
the water will "wet" neighboring sites of the hypercube 
iteratively as long as their energy is below that of the 
lid. Following this process, the water front progresses 
continuously, submerging successive sites until a pool is 
formed. There exists a critical value of the lid beyond 
which the water can pour into the basin belonging to the 
mirror ground state. This is the barrier we shall be in- 
vestigating. The computer program calculates not only 
the height of the barrier, but also the area of the pool 
(the number of wet sites) just before the leaking begins 
and the Hamming distance from the source to the pass 
or passes leading to the mirror basin. We refer to this 
basin as the ground-state valley. 

The time needed to execute this code for one instance 
of 30 spins takes from a few hundred to several thousand 
seconds and strongly depends on the geometry of the 
model. For example, for Barabasi- Albert graphs it is 
about 3300 seconds. This time is even longer for regular 
graphs with k = 2: the ground-state valley is often very 
large and the algorithm needs much time to fill it and to 
reach the pass leading to the other ground state. 



III. INHERENT STRUCTURES 



A. The case of the ring geometry 



When x(i, i + 1) > 0, the bond (i, i + 1) is satisfied, oth- 
erwise it is unsatisfied. An unsatisfied bond corresponds 
to having a domain wall (after resorting to a gauge trans- 
formation) . Note that because of the periodic boundary 
conditions imposed, the number of domain walls in all 
configurations has the same parity as in the ground state. 

In an inherent structure, if x(i,i + 1) < 0, then neces- 
sarily x(i — 1, i) > \x(i,i + l)\ < x(i + l,i + 2). These con- 
ditions are equivalent to having: (i) |Jj_i ( j| > |Ji.i+i| < 
| Jj + i.j + 2|, plus (ii) the two neighboring bonds of the un- 
satisfied bond + 1) must be satisfied. Let M be the 
number of bonds (i, i+1) for which these last two proper- 
ties hold. Then, there are M possible binary choices (ei- 
ther passing or not passing a domain wall through each 
of the bonds), leading to a number of inherent states 
N s = 2 M , a result derived over two decades ago 0,^1- 

For any given instance of the Jy , one can easily de- 
termine the set of bonds + 1) satisfying | J< x,*| > 

| < | Ji+i,i+2|. Although no two such bonds can be 

adjacent, the correlations are short range. As a conse- 
quence, the number M of these bonds is extensive as well 
as their variance. In fact, M is asymptotically distributed 
as a Gaussian random variable according to the central 
limit theorem. Furthermore, it can be shown [Til Il5| 
that for any continuous distribution of the J^, one has 
the remarkable property 
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0.231049. 



(4) 



(5) 



as indicated in Tablc||J Finally, given that M is Gaussian, 
N s follows a lognormal distribution at large N. 

This simple example allows us to guess what happens 
in other finite connectivity models. The role of the lo- 
calized domain wall should be replaced by a local cluster 
of spins that can flip [l6|. If there are M such clusters, 
the number of inherent states will be roughly 2 M ; finally, 
if as expected M is a Gaussian random variable at large 
N, then N s will be lognormal. 



We first consider the case of the ring geometry as it 
will allow us to understand the generic behavior of most 
of the other models. We thus consider a graph that is a 
ring with N spins and periodic boundary conditions: this 
corresponds in fact to a particular k = 2 regular graph 
and it is easy to see that the properties we shall obtain 
are also those of this class of graphs (where one generally 
has several rings) . 

A configuration {<Ji\i—x .. n is an inherent structure if 
and only if each of its spins is parallel to its local field. 
To describe such a configuration, it is convenient to focus 
on 

x(i, i + = (7iJi. i+1 a l+ i (3) 



B. The mean multiplicity 

For all our models we find that the number N s of in- 
herent structures grows exp onentially with N. Earlier 
analytic work 0, 0, 0, Il9| has established this for reg- 
ular graphs (including the complete ones). We recover 
these results numerically, extending them to the scale- 
free graphs (see fig. 

The slope of In (N a ) versus N is given in Table [I] for 
a sample of models. We recall that the analytic result 
H [H 13 for the SK model is 0.1992 . . ., to be com- 
pared with 0.1988(2) read from our table. We find this 
agreement remarkable and encouraging, indicating that 
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FIG. 2: Plot of In (N s ) versus N and associated linear fits. 
Diamond: KR (k — 2), square: KR (k — 4), triangle up: SK, 
circle: BA (m = 2), triangle down: BA (m — 1). 

reliable results can be obtained from rather small sys- 
tems. We also reproduce a qualitative result of ref. |19j : 
for regular graphs the slope decreases with increasing 
connectivity. (Note that we cannot compare our figures 
quantitatively with the analytic predictions of ref. [Tflj 
because the definitions of metastable states used are dif- 
ferent). In contrast, this trend with connectivity is not 
found in inhomogeneous graphs of the Barabasi- Albert 
type, where the slope is larger for m — 2 than for m = 1 
(m is the number of links attached in one step of the 
growth process, thus the average connectivity equals 2m 
up to finite size corrections). Note that the case m = 1 
produces tree networks (that is no loops are generated). 

It is also of interest to consider the average of \nN s 
rather than the log of the average. The results for these 
averages also show a clean linear behavior with N, and 
the slopes are given in Table [I] We see that in all cases, 
the two values are numerically close; the potential differ- 
ences will be discussed in Sect. IIIIDl 



C. The multiplicity distribution 

The exponential growth of N s with N indicates that 
\nN s is an extensive quantity. For finite connectivity 
models it is natural to guess that this "entropy" arises 
from localized excitations |l6[ that are extensive in num- 
ber. Indeed, starting with a ground state, one expects to 
have an extensive number of small sized clusters (say of 
just two spins as an example) that can be flipped while 
keeping each spin parallel to its local field. (The corre- 
sponding modified configuration then remains an inher- 
ent structure.) Furthermore, this "gas of clusters" should 
be weakly interacting. (We thus have a generalization of 
what happened in the ring geometry, although it was do- 
main walls that played the role of the localized objects 
there.) This picture should hold for all finite connec- 
tivity models so we focus on those first, postponing the 



TABLE I: Slope of the least-square linear fit of In (As) (re- 
spectively (In A s )) versus N. Only statistical errors are esti- 
mated; the lower figure for k — 2 is the exact value. The fact 
that for SK the lower figure is slightly larger than the upper 
one is a finite-size artifact reflecting the decrease with N of 
the variance of \nN s discussed in the text. 





KR k — 2 


KR k = 4 


ER (Jfe) = 4 


slope of In {N a ) 
slope of (In N s ) 


0.2417(3) 
0.2310490 


0.2179(2) 
0.2163(2) 


0.2029(2) 
0.1997(2) 




BA (m=2) 


BA (m=l) 


SK 


slope of In {N B } 
slope of (In A s ) 


0.1787(3) 
0.1728(3) 


0.1640(4) 
0.1510(3) 


0.1988(2) 
0.2008(2) 



discussion of the SK model to later. 

If one can excite an extensive number of clusters and if 
these interact only weakly, we expect not only the mean 
but also the variance of hiN s to be linear in N. Our 
numerical data show that this is indeed the case as dis- 
played in fig. [3J The fits are good, especially when the 
slope is large. Now pushing the weakly interacting gas 
picture further, one expects a central limit theorem be- 
havior for In N s . We have thus calculated its higher order 
cumulants ft 3 and K4. Here the errors are rather large 
and so only the qualitative behavior with N can be ex- 
tracted. The general trend is that the scaled cumulants, 
i.e., K3/er 3 / 2 and n^/a 2 , are decreasing and probably go 
to zero at large N. (At N = 30 they are both < 0.1.) All 
this indicates that the multiplicity distribution becomes 
lognormal at large N: 

exp(-(lnA s -(lnAy)72(7 2 ) 

where a 2 is the variance of In N s . This distribution is 
illustrated for the KR k = 4 model in fig. Q] Similar 
results are obtained for other models (data not shown). 
The k = 2 case is somewhat special since the multiplic- 
ities there are always equal to integer powers of 2 as we 
saw in the ring geometry. 

D. The special case of the SK model 

Now we move on to the SK model which behaves some- 
what differently from the other models because of its 
infinite connectivity. Both ln(iV s ) and (lnJV a ) increase 
linearly with N, as already mentioned. The difference 
with the other models concerns the variance of In N s ; as 
shown in fig. |3 this variance decreases as N grows. (The 
line displayed there is to emphasize the trend, the actual 
behavior is an inverse power law with N.) Note that the 
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FIG. 3: The plot of Var[ln7V s ] versus N (linear regression). 
Triangle down: BA (m = 1; tree), diamond: KR k = 2, circle: 
BA (m = 2), star: ER (k) = 4, square: KR k = 4, triangle 
up: SK. 




FIG. 4: The multiplicity distribution for the regular k — 4 
geometry (histogram with bin size = 100). The ordinate is the 
value of N s for an instance. (Summed over our instances with 
N — 30, we have a total of 10105 instances; note the events 
at large N s arising from just one instance). The solid curve is 
the lognormal function with the same mean and variance as 
in the numerical data. 

slope of the other models is always positive but decreases 
as their connectivity increases; for instance the slope is 
close to zero but definitely positive for the ER (k) = 4 
model. 

Neglecting the higher order cumulants of lnN s , one 
has 

In (N s ) = (In N s ) + i Var(ln N s ) (7) 

Thus, as N — > oo, we have for our finite connectivity 
models 

4[ln(JV s )-(lnJV s )]-» const (8) 




FIG. 5: The multiplicity distribution for the SK model. The 
ordinate is an instance's number of inherent structures (data 
for N — 30 and 15607 instances). The line is the lognor- 
mal curve with the same mean and variance of lnJV s as in 
the numerical data. Notice that in the tails the data deviate 
somewhat from the curve. As stated in the text, for SK the 
scaled higher order cumulants, although "small", are never- 
theless about twice what they are in the other models. 



This shows that in such models, the two different kinds 
of averages are distinct, though their difference is nu- 
merically rather small. However, for the SK model, the 
constant on the r.h.s. (right hand side) is zero because 
the variance is sub-extensive. This justifies why we find 
(lnJVg) to be so close to ln(JV s ), in agreement with the 
theoretical result that the two averages coincide in the 
thermodynamic limit. This particular property seems to 
be specific to the SK model because of its infinite con- 
nectivity. 

How can these results be understood? Clearly we can- 
not rely on the simple picture derived from localized clus- 
ters because in the SK model every spin is interacting 
with every other one. Do low energy excitations never- 
theless consist of just a few spins? To find out, recall [2(j 
that in the ground state, the field hi felt by a spin ui has a 
distribution P(hi) w at small fields; thus small fields 
are rare. Because of this, the number of two spin exci- 
tations that will produce an inherent structure is only 
O(l)! Going from 2 to k spins increases this number, 
in fact it becomes exponentially large in k. Because of 
this, one is driven to k — O(N) so the vast majority of 
inherent structures correspond to excitations with O(N) 
flipped spins, explaining why hiN s is extensive in the SK 
model. Furthermore, for such large number of spin flips, 
the detail of the Jy gets washed out. Thus one expects 
very little instance to instance fluctuations of lnA^, sug- 
gesting correctly that Var(lniV s ) is small. 

Finally, we have investigated the distribution of In N s 
(see fig. |SJ. Surprisingly, just as in the finite connectivity 
models, it seems to be lognormal, as indicated by the 
smallness of cumulants of order 3 and 4; these cumulants 
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are rapidly decreasing with N and are around 0.2 at N — 
30. We have no qualitative justification for this simple 
result. 



E. The multiplicity as a function of energy 

To get further insight, it is instructive to consider the 
dependence of the number of inherent structures as a 
function of their energy. We first define the scaled excita- 
tion energy per spin e = (E — E )/ JN where E denotes 
the ground state energy. Second, we introduce a binning 
for e and define D{e) as the number of inherent struc- 
tures whose (excitation) energy density is in [e, e + 5s], 
divided by Se. 

Actually, it is convenient to renormalize D{e) by divid- 
ing it further by y/~N, as we now explain. Let s(e) denote 
the density of the "configurational entropy" so that 



= J de(D(e)) = J deexp (Ns(e)) 



(9) 



Assume that s(s) takes its maximum value at e = e Tl 
Hence at large N 

{N s ) cx / deexp(N[so + ^s 2 (e- e m ) 2 ]) 



oc exp(As )/ViV (10) 

However, our data, especially for the SK model, indi- 
cate that N s increases exponentially with N, without any 
power prefactor. If so, there must be a factor yf~N miss- 
ing in ©, in the relation between D(e) and exp (jVs(e)). 

Hence, we redefine s(e) by s(e) = TV -1 In [{D(e))/y/~N], 
which amounts to adding a finite-size correction. To sim- 
plify the writing we hereafter absorb the factor l/y/N in 
the definition of D{e). 

In fig. [S]we show s(e) = N^ 1 In (D(e)) versus e for the 
SK model (and in the inset for the BA (m=2) model) 
for N — 20, 25, 30 as well as our N — oo extrapolation. 
The result of this extrapolation is close to that shown 
in fig. 2 of ref. [5|, where it has been calculated in the 
mean field approximation, with two differences: it does 
not fall to zero when e — > 0, and at the maximum it 
overshoots by 4.5% the exact value 0.1992 . . .. However, 
our data have been collected at small N, and there are 
uncertainties with our extrapolation, so the agreement is 
actually pretty good. For the SK model, the extrapolated 
data are very well fitted by the parabola 



s{e) = 0.064167 + 1.2582e - 2.7173e 2 



(11) 



This has a maximum at e sa 0.23 and vanishes at e ~ 
0.51. 

An interesting quantity (independent of the normal- 
ization of D(s)) is the ratio 
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FIG. 6: The histogram of A^ -1 In {D(s)) versus the excitation 
energy per spin e for the SK model at A^ = 20 (circles), 25 
(squares) and 30 (diamonds). The triangles are the result of 
an N — » oo extrapolation. The bin size is 0.004 for e < 0.04 
and 0.04 otherwise. Inset: the same for the Barabasi- Albert 
geometry, m = 2. 



It is plotted in fig. [7| In part (a) of that figure, we 
illustrate the behavior of R(e) for the Barabasi- Albert 
geometry; the ratio is either constant or increases slowly 
with (-D(e)) (and thus with N). A similar behavior is 
observed for other finite connectivity models. In part 
(b), we show R(s) for the SK model; the ratio is con- 
stant for the energy bin [0, 0.12] and decreasing for larger 
excitation energies. 

We also find that for all e the shape of the distribution 
of D{e) is consistent with a lognormal law. If it were 
exactly lognormal, one would have 



R{e) 



exp (cr 2 (e)) — 1 



(13) 



where tr 2 (e) = Var[lnZ?(e)]. 

If R keeps decreasing as {D) — ► oo, the distribution 
of the density of inherent structures becomes more and 
more peaked, leading to 



JV 



lim ln(£>(e))/(ln£>(e)) = 1 



(14) 



This is what Bray and Moore find in the SK model for 
scaled excitation energies > 0.12, where as they claim 
the "metastable states are uncorrelated" . In our data 
the fall of R is not as rapid as expected for a Poisson 
distribution, but the qualitative trend is similar. Unfor- 
tunately, we are unable to determine the critical energy 
very precisely, we can only state that our SK data are 
compatible with the results of ref. [5| • 



IV. BARRIERS AND VALLEYS 



A. Framework 



(12) 



The motivation for studying the scaling behavior of 
energy barriers separating inherent structures is well 



7 




<D> 



FIG. 7: The ratio R = sj {D 2 } - (D) 2 /{D) versus (D). (a) 
Barabasi- Albert geometry, circles : < e < 0.16, squares: 
0.16 < e < 0.32 (b) SK geometry, circles: < e < 0.12, 
squares: 0.12 < e < 0.24, triangles: 0.24 < e < 0.36. 



TABLE II: The barrier and the valley exponents. Top num- 
bers: slope of the least-square linear fit of InB versus IniV. 
Bottom numbers: slope of lnln7V we ^ versus IniV. Only sta- 
tistical errors are estimated. 





ER (k) = 4 


KR k = 4 


BA (m=2) 


SK 


barrier exponent 
valley exponent 


0.285(4) 
0.781(5) 


0.244(6) 
0.708(5) 


0.363(4) 
0.811(4) 


0.335(3) 
0.644(6) 



known: barriers that grow with N suggest a frozen (spin 
glass phase) at T — while finite barriers suggest a para- 
magnetic system. Here we focus on the energy barrier 
between the two ground states related by spin flip sym- 
metry, which is expected to be the system's largest bar- 
rier. To go from one ground state to the other, all spins 
must be flipped and so we are interested in finding: 

(a) the height of this barrier; 

(b) the appropriately defined distance between the 
ground state and this barrier state; 

(c) the number of configurations that can be reached 
starting from one ground state while staying below this 
barrier height. 



B. The barrier exponent 



The energy landscape of a disordered and frustrated 
system generically has many valleys and energy barriers. 
Studies of barriers in spin glasses have focused almost 
exclusively on the Sherrington-Kirkpatrick case: (1) On 
the analytical side, Rodgers and Moore Q performed an 
analysis of free-energy barriers near T c and found an N 1 ^ 3 
scaling. (2) Numerical investigations have estimated bar- 



riers indirectly via the relaxation times of Monte Carlo 
dynamics; the most recent simulations give further 
support to an N 1 / 3 scaling. Very recently |2l|. a de- 
tailed study of barriers has been performed analytically 
for spin glasses on random graphs, but for a Hamiltonian 
involving three-spin interactions rather than the two-spin 
interactions of Eq. ^ In this work we shall study directly 
the energy barrier scalings for our four kinds of models, 
finding that the exponent depends on the nature of the 
underlying graph. 

The energy barrier of interest is the one encountered 
when going from one ground state to its flipped counter 
part. (Recall that our system has a global spin flip sym- 
metry.) This energy barrier is expected to be the largest 
of all barriers. We determine it with our lid algorithm 
by letting the "water" proceed from the source (one of 
the ground states) up to the level given by the lid. When 
this level crosses the value Bj (the barrier for the in- 
stance under consideration), the water will flow all the 
way to the other ground state. Bj is a random vari- 
able (depends on the instance), so we have determined 
its moments and distribution as a function of N. 

For each N and kind of model (KR, ER, ...), we have a 
numerical estimate of the distribution of Bj; define B as 
the energy for which this distribution is maximum. We 
show in fig. [S] the log- log plots of B versus N for several 
of our models. (A similar plot can be obtained from the 
mean of Bj , but our definition of B leads to more stable 
results) . The numerical values of the slopes are collected 
in Table HD 

The errors given in Table [H] are statistical only. The 
systematic errors are likely to be more important. We 
do not have them fully under control, but they can be 
roughly estimated as follows: the value of the exponent 
depends on the observable used to extract it, namely the 
average of the barrier height or its modal value. Com- 
paring these different observables, we expect the system- 
atic error on the barrier exponents to be around ±0.02. 
Similarly, the systematic error attached to the valley ex- 
ponents discussed in the next section is tentatively esti- 
mated to be around ±0.05. 

The result for the SK model gives strong support for 
the conjecture of a barrier scaling as N 1 / 3 ; note how well 
the data follow this scaling, starting even at such low 
values as N = 10. Power scaling is also very clear in 
the other models, though the scalings seem to set in a 
bit less early. For instance, our fits for KR graphs with 
k = 4 lead to effective slopes that decrease as the lower 
range in N used for the fitting is increased; our best 
estimate for the exponent is then 0.244(6), a result com- 
pletely incompatible with 1/3. We thus conclude that 
barrier exponents depend on the nature of the underly- 
ing graphs. It is manifest that for the homogeneous finite 
connectivity models studied here the barrier exponent is 
significantly lower than for SK (a similar result is found 
e.g. for Erdos-Renyi graphs with average degree equal to 
3). The inhomogeneous Barabasi- Albert models behave 
differently, more like SK, and there is no indication in 
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FIG. 8: The barrier height B as a function of N: circle: BA 
(m = 2), star: ER {(k) = 4), square: KR (k = 4), triangle 
up: SK. The ordinate for the SK points has been shifted by 
—0.05 to make the figure less cluttered. 



our data that such a trend is due to finite size effects, 
although this possibility cannot, of course, be totally ex- 
cluded. 

In contrast to the quantity N s , we find that Bj is self- 
averaging, i.e. its relative fluctuations decrease and go to 
zero as N grows: 

\ b j) 

with the exponent 7 ranging from about 0.14 (SK model) 
to 0.30 (KR k = 4 model). From such a self-averaging 
behavior, one may guess that Bj is to some extent a sum 
of many small barrier heights. 

C. The valley exponent 

Let us consider now the number of configurations that 
are wet just before the barrier is reached. Since the pro- 
cedure wets all reachable configurations in its search of 
the pass, this number measures the size of the valley or, 
stated differently, the size of the basin of attraction of 
the ground state. It turns out to depend strongly on the 
geometry of the model. Thus, for example, at N = 30, 
the average number of wet sites is 2940 in the SK and 
40000 in the BA (m = 2) model, respectively! 

Each wet site represents a configuration of the system. 
We observe that nearly all configurations or their associ- 
ated flipped partners whose excitation energies are lower 
than Bj, the height of the barrier, get wet. This is true 
for all models and says that Bj is probably as expected 
the largest energy barrier in the system. 

We define N we ^ as the most probable number of wet 
configurations when the lid finally reaches the barrier. 



(It is thus extracted from all of our instances at a given 
N, just as B was.) We find the simple scaling property: 

N wet ex exp (cN v ) (16) 

where c is a numerical constant. The value of the "valley 
exponent" v is always below 1, see Table ITT1 (Note that 
we have also performed the analysis using the mean num- 
ber of wet configurations rather than the modal value and 
the results are very similar.) 

Let us present a heuristic argument for why a stretched 
exponential as in Ea. H16|) is natural. The wet sites repre- 
sent configurations with energies differing relatively little 
from the ground state energy Eq, the extreme energy of 
the system, proportional to N. A simple guess is that 
the (microcanonical) entropy density s(e) vanishes as 

s(e) ~ A(e~e Q ) a (17) 

as e = E/N tends towards the ground state energy den- 
sity eo = Eq/N. (Here A is a constant and a is a positive 
exponent.) Then the probability that a configuration has 
energy density e is 

P(e) cx exp (NA(e - e ) a ) (18) 

for e tending towards eo- Using the fact that for con- 
figurations below the energy barrier Bj, e — eo becomes 
infinitesimal as N — - > 00, the number of wet configura- 
tions is 

N wet (x / P(e)deoc / exp (AN{z/N) a )dz 

Je JO 

where (3 is the barrier exponent. For large N the integral 
is dominated by the upper limit and one gets (|Td|| with 
v — a/3 — a + 1. Using our measurements of (3 and this 
gives values of a ranging from about 0.3 to approximately 
0.5. Related considerations can be found in ref. 122. 



D. Ground state to barrier state distances 

The idea of our algorithm was briefly explained in 
Sect. Ill 01 Along the shortest path from the ground state 
to the saddle point (pass), a given spin can get flipped 
more than once. This path has to avoid multiple obsta- 
cles and can be quite tortuous. It is not explicitly con- 
structed by our simple "wetting" algorithm which merely 
identifies the location of the saddle point in the config- 
uration space. Once this is done, one easily finds the 
Hamming distance separating the ground state and the 
saddle point, i.e. the barrier state. The mirror state is 
then also easily identified. 

The distribution of the Hamming distances separating 
the ground state from the pass is shown in fig. [5] the 
distribution is the least broad for the SK model and the 
broadest for regular graphs with k = 3. Other models, 
including the Barabasi-Albert one, exhibit intermediate 
behaviors. 
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FIG. 9: The normalized Hamming distance distribution sep- 
arating the Boolean hypercube sites representing the ground 
state and one or the other saddle-point (for N = 20); empty 
circles: SK, full circles: KR k — 3. 



Detailed investigations shows that just before the lid 
energy is reached, in almost all cases the two passes (re- 
lated by a global spin flip) are both on the boundary of 
the wet sites. From this fact, we can reach a useful qual- 
itative picture of the energy landscape. Recall that each 
ground state valley corresponds to a connected cluster of 
vertices of the N dimensional Boolean hypercube. Gener- 
ically, two barrier configurations, related by a global spin 
flip symmetry, form the "passes" where the two valleys 
"touch" . This is very different from what happens in a 
one dimensional energy landscape. There, if one has two 
passes, then the two valleys do not touch, instead an in- 
termediate zone separates them. In our systems, only on 
very rare occasions (at the level of about 1 in 1000) have 
we found that a valley is in contact with just one pass. 
Thus in the generic case, the valley to valley barrier is 
associated with two passes, both in contact with each 
ground state valley. 



V. SUMMARY AND CONCLUSION 

Many complex systems can be represented by a com- 
plicated network connecting a large number of simpler 
subunits. The knowledge of the network architecture is 
an important piece of information, but it does not tell 
much about the system's global behavior. Instead, it is 
frequently the energy landscape that is relevant for the 
cooperative behavior of systems consisting of many inter- 
acting units (see refs. |2J,|2^). An interesting question 
is: what is the relation between the system's behavior 
and its design? Between the shape of its energy land- 
scape and the topology of its network? This question 
motivated our investigation. 



Our study focuses on spin glasses that are archetypes of 
complex systems. A major conclusion of our work is that 
reliable results can be obtained from quite small systems, 
provided the enumeration of configurations is exhaustive: 
for example, in the SK model we reproduce correctly the 
first three significant digits of the quantity TV -1 In (N s ) 
(which has been calculated analytically long ago). The 
techniques we use are relatively straightforward, but al- 
low us to unveil essential aspects of the energy landscape 
in these systems as we now summarize. 

We find that the distribution of the number of inherent 
structures is lognormal in all examined models. This usu- 
ally reflects the extensivity of local excitations and their 
low level of correlations, a property that should hold in 
a variety of other models with finite connectivity. 

We further observe a simple scaling behavior with the 
number of spins of the size of the ground state basin of 
attraction and of the height of the energy barrier between 
the two degenerate ground states, respectively. However, 
the corresponding exponents are not universal. For in- 
stance, the barrier exponent in the SK model (equal to 
1/3) is definitely larger than the exponents found in all 
models where underlying graphs are homogeneous. Sim- 
ilar results hold for the valley exponent. Nevertheless 
there is some level of universality: the exponents seem 
to be independent of the underlying Jy distribution. For 
instance in the SK model, the barrier exponent is, within 
the limits of our systematic error, the same when the Jij 
are generated from an exponential distribution and from 
the Gaussian distribution; we have also checked this for 
the KR k — 4 model, though finite size effects there were 
stronger. We find this level of universality to arise also 
for the valley exponent. 

On the whole, the qualitative behavior of the models 
we considered is very similar, with one notable exception: 
the variance of In N s decreases with N in the SK model, 
while it increases in all models with finite connectivity 
graphs. This difference is quite essential and signals a 
qualitatively different nature of this complex system, ar- 
guably due to the absence of small scale excitations. 

In spite of their qualitatively similar behavior, the 
models are very different quantitatively. The seemingly 
small differences between parameters plotted in figs. 121. SI 
translate into large differences of multiplicity distribu- 
tions. For instance, the size of the basin of attraction in 
the BA (m = 2) model is one order of magnitude larger 
than in the model where graphs are regular with degree 
4, etc. 

This paper is an exploratory one and many questions 
remain open. We showed in Sect. IIV Dl that the two 
ground state valleys had a connectivity property that 
was inexistent in one dimensional energy landscapes; it 
would be of interest to understand the nature of passes 
between more general valleys in these systems. It would 
also be worthwhile to explore the topology of the graph 
associated with the inherent structures. Such inherent 
networks have been constructed, for example, for certain 
atomic clusters (2^, |2{g. We would like to see whether 
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there is some relation between the underlying topology 
of the model and the topology of its inherent network. 
However, the nontrivial definition of the latter for a dis- 
crete system like a spin glass requires a separate discus- 
sion; this issue is beyond the scope of the present paper. 
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